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(54) Video signal processing 

(57) A method of distinguishing from "true" video, 
video material which was originated on film video or, 
more generally, detecting the residual effect of a past 
conversion from a lower temporal sampling rate involv- 
ing the repetition of images. Involves measuring a mo- 
tion parameter such as a field averaged motion vector 



magnitude. A difference value is taken from successive 
motion parameters; this is subtracted from the motion 
parameter and the results of said comparison are accu- 
mulated. A trend of positive results is indicative of "true" 
video and a trend of zero or negative results suggests 
image repetition. 
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Description 

[0001] This invention relates to video signal process- 
ing. 

[0002] It is well known that a variety of video process- s 
es which are optimised for video material having a par- 
ticular temporal sampling rate, can function differently - 
and usually less well - with video material transferred 
from film or converted in some other way from an original 
temporal sampling rate which was lower. If the origins to 
of the video material which is to be processed are 
known, the process can be appropriately optimised at 
the outset. A difficulty arises where the origins of the ma- 
terial are unknown or where the video materia! Is a com- 
pilation of material having different origins. Video mate- '5 
rial which originated from film (whether 24 Hz, 25 Hz or 
30 Hz), slow motion replays and animation will usually 
have repeating images which will lead to sub-optimal 
perfomnance in particular video processes, unless cor- 
rectly identified. 

[0003] It is an object of the present invention to pro- 
vide a relatively straightfonward yet reliable method of 
detecting, in a video signal having a particular temporal 
sampling rate, the residual effect of a past conversion 
from a lower temporal sampling rate involving the repe- 25 
tition of images. 

[0004] Accordingly, the present invention consists in 
a method of detecting, in a video signal having a partic- 
ular temporal sampling rate, the residual effect of a past 
conversion from a lower temporal sampling rate involv- 30 
ing the repetition of images, comprising the steps of 
measuring a motion parameter between successive im- 
ages, determining a difference value between succes- 
sive measured motion parameters; comparing the mo- 
tion parameter and difference values and accumulating 35 
the results of said comparison. 
[0005] Preferably, the motion parameter comprises 
the average magnitude of the motion vectors. 
[0006] Suitably, the results of the comparison are ac- 
cumulated by monitoring a trend in the sign of the com- 
parison. 

[0007] This invention can operate using any of a wide 
variety of known techniques for splitting a picture into 
blocks and measuring a motion vector between these 
blocks in successive images. The average vector mag- ^ 
nitude is calculated from the motion vectors measured 
between every successive image. The magnitude of the 
temporal differential of the average vector magnitude is 
calculated and this number is subtracted from the aver- 
age vector magnitude. It is to be expected that in "true" so 
video material the temporal differential of the average 
vector magnitude will tend to be less than the average 
vector magnitude. The subtraction will therefore gener- 
ally produce a positive result and by noting a trend of 
positive results, the material can be inferred as video ss 
originating. 

[0008] In the case of material which was originated as 
film, the average vector magnitude will switch from a val- 



ue which is representative of the picture content to an 
artificially low value (theoretically zero) where motion is 
measured between two fields which originate from the 
same film frame. With this variation, the differential of 
the average vector magnitude will be generally high 
compared to the average vector magnitude itself. Ac- 
cordingly, subtracting the differential measurement from 
the actual measurement will produce a zero or negative 
result and a tendency towards negative results will en- 
able detection of film originating material. 
[0009] In converting from 24 Hz film to 60 Hz NTSC. 
it is usual to employ the well known 3:2 pulldown se- 
quence. For subsequent video processing, it is desira- 
ble not only to detect the character of the film originating 
material but also to identify the precise phase in the field 
duplicating and reordering sequence that arises from 
the 3:2 pulldown process. 

[0010] . Apparatus which detects the phase of the 3:2 

pulldown sequence already exists and reference Is di- 
rected for example to WO/91 06182. Known approach- 
es generally compare fields from successive video 
frames to derive a field difference signal which will be 
expected to be small in the case of duplicate fields add- 
ed in the 3:2 pulldown. A logic arrangement is then pro- 
vided to identify a repeating pattern in the sequence of 
field difference signals. It is an object of the present in- 
vention to provide an alternative method for identifying 
the phase of the field duplicating and reordering se- 
quence in video material resulting from a 3:2 pulldown 
process. 

[001 1 ] Accordingly, the present invention consists, in 
a further aspect, in a method for identifying the phase 
of the field duplicating and reordering sequence in video 
material resulting from a 3:2 pulldown process compris- 
ing the steps of measuring a motion parameter; storing 
a sequence of measured motion parameters for succes- 
sive fields; comparing the pattern of motion parameters 
with known patterns associated respectively with differ- 
ent phases of the field duplicating and reordering se- 
quence and selecting the phase providing the closest 
match. 

[001 2] The present invention will now be described by 
way of example with reference to the accompanying 
drawings in whtoh:- 

Figure 1 Is a block diagram illustrating apparatus 
according to one aspect of the present invention, 
for distinguishing between video originated and film 
originated material; 

Figure 2 is a block diagram illustrating apparatus 
according to a further aspect of this invention for 
identifying the phase of a 3:2 pulldown sequence 
and Figure 3 is a block diagram illustrating, in more 
detail, one component of the apparatus of Figure 2. 

[0013] Refen-ing initially to Figure 1. video material 
passes to a motion estimator 1 0 which generates motion 
vectors. The motion estimator can take a wide variety 
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of known forms with a particularly suitable technique be- 
ing that of phase correlation as disclosed, for exannple. 
In GB-B-2 1 88 51 0. The magnitude of the motion vectors 
derived by the motion estimator 1 0 is calculated in block 
12 and these magnitudes are averaged for each field in 
block 14. The field-averaged vector magnitude, which 
can be regarded as a motion parameter for that field, is 
taken directly as one input to subtracter 16 and via a 
field delay 18 to form the other Input of the subtracter. 
The output of the subtracter, which is then the difference 
in the motion parameter for successive fields, is then 
passed through block 20 which serves to extract the 
magnitude. A further subtracter 22 takes as its positive 
input, the current motion parameter and as its negative 
input the magnitude of the difference signal. 
[0014] As has been previously noted, a tendency to 
positive results in the subtracter 22 will be indicative of 
video originating material whilst a tendency towards 
negative results will be indicative of film originating ma- 
terial. The remainder of the circuit shown in Figure 1 is 
concerned with identifying these tendencies in a manner 
which is reliable, which responds in a proper manner to 
cuts between film originated and video originated mate- 
rial and which deals in a sensible manner with picture 
material having finite but unusually low movement. 
[0015] Thus, the output of subtracter 22 passes 
through multiplier 24 perfonning a x 1 6 operation. As will 
be described subsequently, the choice of coefficient for 
the multiplier affords a degree of sensitivity control for 
process. The output of the multiplier 24 passes to block 

25 which serves to clip the signal in both positive and 
negative senses. In this case, the clipping occurs at ± 5 
although, as will be described, the choice of clip limits 
provides a measure of control over the rate at which ap- 
parent changes between video originated and film orig- 
inated material are detected. The clip signal from block 

26 is accumulated and further clipped in an arrangement 
which comprises an adder 28, a clipper 30 and a field 
delay 32. The output of clipper 26 passes through adder 
28 to a further clipper 30 which has a clip limit of ± 25. 
The adder 28 receives as its second input the output of 
the clipper 30 passed through the field delay 32. 

[Q01 6] In the case of video originating material having 
constant motion, the differential vector magnitude will 
be zero and, with the gain afforded by multiplier 24, the 
output from clipper 26 will be continuously + 5. It will be 
seen that after 5 cycles, the output of the clipper 30 will 
reach and will be held at the positive clip limit of i- 25. 
In the more normal case in which there is varying mo- 
tion, the motion vector differential will be non-zero but 
nonetheless smaller on-average than the actual motion 
vector magnitude. The sensitivity provided by multiplier 
24 is selected so that in most cases, the output of clipper 
26 remains at the positive clip limit so that a rate of 
change of 5 cycles, (from the zero condition) still applies. 
In the case of very small motion with, for example, "talk- 
ing heads" picture material, the high gain of multiplier 
24 ensures that information regarding the motion is still 



made use of. The clip limit in block 26 may not be 
reached and the rate of change of the detector output 
will therefore be slow. 

[0017] In the case of film originating material, the out- 
5 put from subtracter 22 will be expected to be zero or 
negative. In an analogous manner, the first clip limit of 
- 5 and the accumulated clip limit of - 25 will apply and 
an output of -25 can be identined with film originating 
material. It will be noted that an output of zero is taken 
10 simply to mean "don't know". 

[0018] The five-foid relationship between the clip lim- 
its of block 26 and 30 have been selected to govern the 
delay after which the detector switches between video 
originating and film originating material in the "ideal" 
'5 case of a cut between constant motion film and constant 
motion video. If a longer delay is appropriate, a ten-fold 
or greater differential between the two clip limits can be 
employed. 

[001 9] Turning now to Figures 2 and 3, there is shown 

20 a further embodiment of the present invention which is 
capable of identifying the phase of the 3:2 sequence in 
60 Hz NTSC material originated on film and subjected 
to a 3:2 pulldown. Certain components are shared in 
common with the embodiment of Rgure 1 . These com- 

25 ponents have the same reference numerals and will not 
• be described in any more detail. 
[0020] The output from block 14, which is a motion 
parameter in the form of an average motion vector for 
the field, is taken to a chain of field delays 40-46 These 

30 feed in turn an array of match filters 50-58, clocked at 
field rate by means of a modulo 5 counter 60. 
[0021] Referring now to Rgure 3, there is shown in 
more detail the structure of each match filter 50-58. It 
will be seen that the input to the match filter is taken to 

35 a chain of field delays 70-76 which feed multipliers 
80-88. The coefficients A to E supplied to these multi- 
pliers, var/ in the clock cycle as follows:- 
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[0022] The output of the multipliers 80-88 are taken 
through adder 90 which generates the output for the 
match filter. 

[0023] Returning to Rgure 2, the outputs of the match 

filters are taken through respective recursive filters 
1 00-108 which generate the five inputs for selector 110. 
The function of this selector is to pick the largest output 
from the recursive filters 1 00-1 08. In the ideal case, only 
one output wilt be positive. There is preferably hystere- 
sis built into the selector 110 so that shon temri shifts In 
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the ranking of the inputs, arising from noise, are ignored. 
The coefficient sequence of the selected match filter in- 
dicates the field sequence of the input video. 
[0024]' it should be understood that this invention has 
been described by way of example and a wide variety s 
of modifications are possible without departing from the 
scope of the invention. Whilst the example has been tak- 
en of 3:2 pulldown, the method of the invention is capa- 
ble of, more generally, detecting the residual effect of a 
past conversion from a lower temporal sampling rate in- io 
volving the repetition of images. 

Claims 

IS 

1. A method for identifying the phase of the field du- 
plicating and reordering sequence in video material 
resulting frorri a 3:2 pulldown process, comprising 
the steps of measuring a motion parameter; storing 

a sequence of measured motion parameters for ' 20 
successive fields; comparing the pattern of motion 
parameters with known patterns associated re- 
spectively with different phases of the field duplicat- 
ing and reordering sequence and selecting the 
phase providing the closest match. 

2. A method according to Claim 1 , wherein the step of 
measuring a motion parameter comprises identify- 
ing a plurality of motion vectors associated with re- 
spective regions of the image and taking the aver- 30 
age magnitude of the motion vectors. 

3. Apparatus for identifying the phase of the field du- 
plicating and reordering sequence in video materia! 
resulting from a 3:2 pulldown process, comprising 3S 
means for measuring a motion parameter; means 

for storing a sequence of measured motion param- 
eters for successive fields; means for comparing 
the pattern* of motion parameters with known pat- 
terns associated respectively with different phases ' 40 
of the field duplicating and reordering sequence and 
means selecting the phase providing the closest 
match. 

4. Apparatus according to Claim 3, wherein said 
means for comparing the pattern of motion param- 
eters with known patterns associated respectively 
with different phases of the field duplicating and re- 
ordering sequence comprises five match filters re- 
ceiving said sequence of measured motion param- so 
eters delayed by one field inten/al from one match 
filter to the next. 
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